You can spray the plants with Japanese beetle killer, found in most retailers and online. Sevin dust can also work, but it might kill beneficial insects along with the Japanese beetles. Some ingredients to look for when purchasing an insecticide are carbaryl, acephate, and permethrin.